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ABSTRACT 



Sharp limitations on measurinq the impact of 
Volunteers in Service to America (VISTA) can be laraelv overcome bv 
developing an improved syste.# and techniques for planninq projects 
and their likely effects. The distinguishing characteristics of VISTA 
for measurement purposes are: a large number of volunteer program 
activities and sponsors, hence great diversity of outcomes; imprecise 
ooals; and a VISTA presence that reinforces program activities but 
also has independent consequences. Maximum feasibility of measurina 
VISTA impact (and maximum benefit to program effectiveness from doinq 
so) depend upon vievina measurement as part of a process that 
includes: analyzina communities to identify key points for VTS m A 
impact; planning projects desianed to achieve specific attitude and 
behavioral change; tralnino volunteers to work toward these 
objectives; and measuring and evaluatino effectiveness accordina to 
designated behavioral indicators related to the specified goals. A 
specific project embodying these elements is described and 
recommended in the report. (There is a mistake in numbering pages in 
document, but nothing is missino.) (EP) 
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SUMMARY 



Measuring the current impact of VISTA on poverty communities 
is feasible but sharply limited. These limitations can be largely 
overcome by developing an improved system and techniques for plan- 
ning projects and their likely effects. Available literature on 
social measurement offers few useful precedents for measurement 
with current or improved programming practices. 

VISTA is not a social program that uses a well-defined approach 
to achieve designated measurable behavioral change goals. Its dis- 
tinguishing characteristics for measurement purposes aret 

1. A large number of volunteer program activities and sponsors 
that yields a great diversity of program outcomes t 

2. General and imprecise goals often interpreted differently 
by volunteers, sponsor agencies, and participating populations} and 

3. A pr oce88 or VISTA presence, based on volunteers living 
and working directly with poor people, that reinforces program acti- 
vities but also has independent consequences. 

VISTA iirpact includes the results of program activities and 
the effects, often less tangible, of VISTA presence. Program acti- 
vities produce direct outcomes chat are currently recorded in VISTA 
Activities Surveys, and additional results, not presently measured, 
that are more remote in time or causal connection. A range of 
measures can be described for each activity category and included 
in Activities Surveys, to quantify the more direct and tangible out- 
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puts of VISTA work. Present programming practices limit applica- 
tion of these measures to review of the volunteer constituency, the 
group identified by the volunteer as having been served by or in- 
volved with him. The diversity and magnitudes of other forces oper- 
ating on poverty communities make it statistically inappropriate to 
isolate VISTA impact in any other way. 

The impact that results from presence and the generalized 
effects of program activities is intangible and more difficult to 
attribute and to measure. Although a wide range of individual 
assistance and community organization outcomes are included, results 
are best expressed, both conceptually and operationally, as changes 
in attitudes. Tabulation at this level of generality encompasses 
diverse and otherwise non-comparable results. No single attitude 
can be identified as the principal target or beneficiary of VISTA 
efforts, but the program influences the entire collection of atti- 
tudes understood as the culture of poverty. 

Although the behavioral manifestations of attitude change vary 
with the approach of the volunteers and the environment and per- 
sonal characteristics of their constituencies, the use of behavioral 
indicators is more promising than tests or interviews for measuring 
attitude change. Attitude surveys and tests are of limited value 
because oft 

1. Cultural and conceptual limitations of design, 




2. Reactive effects with interviewers, 
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3. Invasion of target group privacy and interference with 
volunteer work relationships, 

4. Ambiguous relationships between variables measured and 
respondent behavior. 

• Indicators based on existence of specific types of behavior 
permit measurement of VISTA impact on attitudes by tabulation of 
positive responses. Duration or permanence of impact is tested 
by repeating measurements periodically. By limiting concern to 
direction rather than magnitude of behavioral change, simultaneous 
collection of pre-VISTA and later information is facilitated. Indi- 
cators are concerned primarily with initiatives taken by persons 
involved with VISTA and not with the outcome of those initiatives. 
Behavior can be reported by volunteers without formal interviews 
among target populations and can sometimes be confirmed by refer- 
ence to available public data. Since neither behavioral nor atti- 
tude change goals are specified in advance by VISTA or most sponsors, 
the choice of behavioral indicators must currently depend heavily 
on volunteer perceptions of appropriateness. 

The scientific validity of VISTA impact measurement efforts 
can be increased byt 

1. Historical analysis to establish previously undisturbed 
behavior patterns, 

2. Careful collection of baseline data among groups served by 
VISTA, for comparison with later findings, 
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3. Identifying and conpensating for effects of overlapping 
causes of change, and 

4. Comparing changes among those working with VISTA to changes 
in their neighborhoods or immediately surrounding communities. 

The development of control groups for comparison with VISTA 
constituencies or communities is difficult, costly and impractical. 

Practical approaches to measurement are limited by* 

1. Volunteers' unsympathetic attitudes to measurement and, 
less frequently, to 0E0, 

2. Difficulties of assuring reliable target group responses, 

3. Unavailable or inaccurate public data, 

4. The varied reactions to VISTA among people who are not 
poor, and 

5. The small size of VISTA efforts in relation to other forces 
at work in poverty communities. 

Nevertheless, limited but useful measurements of the impact of 
current projects can be undertaken, using Activities Surveys, Evalu- 
ations, and End-of-Service Questionnaires, as guides to the desir- 
ability of further inquiry. Measurement should be based on volun- 
teer responses about changes in behavioral indicators chosen after 
consultation with them, confirmed by selected target group inter- 
views and review of public data. 

Maximum feasibility of measuring VISTA impc.ct, and maximum 
benefit to program effectiveness from doing so, depend upon view- 
} measurement as part of a process or system that includes i 
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1. Analyzing communities to identify key points for VISTA 
impact, 

2. Planning projects designed to achieve specific attitude 
and behavioral change goals related to these points of impact, 

3. Training and administering volunteer groups to work toward 
these objectives, and 

4. Measuring and evaluating effectiveness according to desig- 
nated behavioral indicators related to the specified change goals. 
By focusing its efforts in this way, VISTA will substantially in- 
crease the possibilities for producing significant impact and for 
measuring it from readily available poverty community data. 

A specific project embodying these elements is described and 
recommended in the report as a key step that VISTA shoved take to 
implement an improved programming and measurement system. 




INTRODUCTION 



Determining the feasibility of measuring VISTA impact is more 
than a matter of identifying previously- ignored indicators of im- 
proved welfare or developing esoteric new scales for exploring at- 
titude changes among the poor. Before these problems of operation- 
al specification are considered, the investigator must review: 

(1) The nature and purposes of the VISTA input, the vari- 
able whose effects are being considered; 

(2) The interactions and relationships of that variable 
with "the poverty community," a term subject to vari- 
ous definitions with different consequences for 
measurement; 

(3) The identifiable results or effects that may be attrib- 
utable, by observation or analysis, to these relation- 
ships and interactions. 

What has been called 'the possibility of slippage between concep - 
tual definition and operational specification " in social measure- 
ment, by scholar 8 concerned primarily with the latter,^ - is of major 
concern only after there is general agreement on conceptual defini- 
tion of the changes to be measured. 

This study is first concerned with identifying and exploring 
the consequences of, and possible solutions for, the formidable 
conceptual problems involved in looking at the impact of VISTA. 

^ Unobtrusive Measures , Eugene J. Webb, et al., Rand McNally, 
Chicago, 1966, p. 5. 



V 



- 2 - 

There follow some attempts at operational specification, involving 
the blocking out of alternatives for measuring the impact of speci- 
fic VISTA projects in the Mid-Atlantic Region. 

The report also suggests a "framework for feasibility," a set 
of realizable conditions that would improve the effectiveness of 
VISTA performance and the possibilities for measuring the impact 
of that performance. By facilitating the conceptual definition of 
VISTA impact, this framework also simplifies the measurement pro- 
blem. 

The choice of program activities and arrangements should not 
be dictated by the possibilities for quantifiable impact or the 
ease of measurement, but the achievement of lasting beneficial re- 
sults from VISTA activities is reflected in successful measurement 
efforts. Results are often more measurable when they are more signi- 
ficant. This study confirms once again that attempts to measure 
results or impact are not academic exercises. They are an integral 
part of the self-evaluation process that produces more useful pro- 
grams. 



O 

ERIC 



3 



X. CONCEPTUAL PROBLEMS 
A. The VISTA Resource 

VISTA is a program that assigns volunteers to work for many 
sponsors in many ways. It is not a self-contained social action 
program directed to the alleviation of specific social problems, 
with defined goals and an hypothesis about the likely effects of a 
particular approach, technique, or resource, when applied to achieve- 
ment of those goals. 

The assignment of volunteers to sponsoring organizations, in 
groups seldom exceeding ten and frequently on an individual basis, 
is one cause of the diffuseness of purpose that clouds VISTA impact 
and makes it difficult to measure. The diversity of assigned acti- 
vities, sponsor goals, and volunteer interpretations of them, adds 
to the problem. Lack of program focus also results in part from 
the requirements for using volunteers effectively. To harness their 
energy and enthusiasm, something more than a structured job assign- 
ment or a narrowly defined goal is thought to be necessary. The 
Executive Director of the Lancaster County, Pennsylvania, Community 
Action Agency, put it this way: 

"It is my philosophy that we should evaluate each indi- 
vidual VISTA to determine where he can best serve the 
community, and in what capacity he wants to serve the 
community, before we make our decision on how to utilize 
him. This is what our agency has attempted to do with 
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all our VISTAs, and it has been our experience that 
when the VISTA is challenged and delighted with his 
assigned work, not only is he fulfilled as an indi- 
vidual, he also provides our agency with extremely 
valuable assistance in fulfilling our goals, it 
seems to be working out very well." M°TC Bulletin, 

Temple University, October 1968, p. 3. 

This approach relegates VISTA to the role of broker between 
sponsors and individual volunteers, seriously limiting opportuni- 
ties to concentrate on specific program goals. The impact of 
VISTA must then be distilled from review of sponsors' accomplish- 
ments and from looking at the diverse activities of volunteers' 
outside job assignments. The flexibility and accommodation neces- 
sary to fulfill volunteers as individuals produces a situation in 
which "...the computer has not yet been built that can classify 

and organize in some rational manner the diverse individual acti- 

2 

vities of several thousand volunteers." 

The VISTA program could be limited to sponsors chosen for 
similarity of goals and providing assignments geared to a few well- 
defined objectives. The small numbers working with each sponsor 
would then create a type of cross-section program concentration. 

The current VISTA program that assigns one professional worker to 
each of 20 different cities to assist in the specific task of mobi- 
lizing "Citizen Volunteers" illustrates the type of concentration 



S. A. Levitan, VISTA - The Great Society's Domestic Volun - 
teers . in Poverty and Human Resources Abstracts, Univ. of Mich., 
Summer 1968, p. 18. 

O 




that could be applied to all VISTA projects. However, this is not 
a typical VISTA pattern. Any study of impact based on current pro- 
gramming must deal with an input that is spread thinly over a 
variety of activities and purposes. It is best defined by "what it 
is" and "how it works" and not by any behavorial change goals identi- 
fied in advance. VISTA is "process-oriented" rather than "end- 
3 

oriented." The identification of impact involves examining the 
process and exploring its likely consequences. This is a different 
and more difficult task than reviewing the results of action pro- 
grams aimed at specified change goals . 

B. The VISTA Process and Presence 

The VISTA process is conceptually separable from the work 
assignments of volunteers. "VISTA presence" or "being a VISTA" 
involves some relationship to a sponsor and contemplates perfor- 
mance of job activities, but is often independent of job content. 

Some job assignments are more consistent with the VISTA process 
and VISTAs may be more effective in some activities because of 
their approach, but program and presence can have different results. 
The statements of a consultant evaluating three VISTA associate 

youth projects that: 

_ - 

This distinction is explained further in Fellin, Rothman, 
and Meyer, "Implications of the Socio-Behavorial Approach for 
Community Organization Practice," in The Socio-Behavorial Approach 
and Applications to Social Work . Thomas, ed.. Council on Social 
Work Education, New York, 1967 . 
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"The major accomplishments were mainly in the area of 
interpersonal relations and in experimental learning...'*; 
and 

"These. . .accomplishments grew out of the relationships 
of the Associates with the children and adults with whom 
they worked , " 

illustrate the often minor role of the structured program assign- 
4 

ments. The accomplishments cited were attributed to presence and 
approach, not program activities. The report encourages program 
activities responsive to local needs mainly because they are 
likely to stimulate relationships that produce the more general 
results described. 

5 

A Columbia School of Social Work study identified typical 
VISTA roles as 1) bridge for communication, 2) catalyst, 3) agency 
innovator, 4) provider of services, and 5) role model. These 
generalized activities, compatible with various program assign- 
ments, are correlates of the accomplishments previously cited, a 
way of translating "VISTA presence" into process terms. They also 
provide a theory for causally linking volunteer efforts and possible 
changes in the attitudes and behavior of people with whom they work. 
More important here than philosophical agreement on the essence of 

4 ' 

Evaluation of VISTA Summer Associates Program , Greenleigh, 
Associates, New York, 1967, p. 11. 

5 

Today is Tomorrow , Marjorie H. Cantor, et al., VISTA 1967, 
Summary and Implications Volume, p. 5. 

0 
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being a VISTA Volunteer is recognition that the input can produce 
both "program" and "presence" results. 

Because the goals and objectives of program and presence have 
not been identified, except in the most general terms, the search 
for impact involves (1) analyzing the likely consequences of VISTA 
presence and program activities, (2) identifying, from observation 
and reports, actual common results, and (3) using these findings 
to develop a prototype or model of impact, before (4) identifying 
measures and indicators of performance that are consistent with 
the conceptual definition. 

C. Program Activities 

Defining the program impact of VISTA Volunteers presents other 
problems. The sponsor system leads to a range of goals and activi- 
ties that diffuses VISTA efforts. A common sponsor is no assurance 
that volunteers share common goals. Individual volunteers may 
engage in various activities addressed to quite different ends. 
Program activities are usually identified by job functions and not 
by desired results. The VISTA classifications of projects as rural, 
Indian, migrant, Job Corps, special, urban, and mental health, are 
by target group and each may include various goals and activities . 

The impact of VISTA on poverty communities would be greater if 
program goals were sharpened and activities concentrated more 



effectively. Present, .programming too often makes VISTA a negligible 
part of the total effort directed to solving particular problems. 

The absence or diversity of program goals makes impact less visi- 
ble and reduces the total of individual impacts or results by pre- 
venting attainment of the synergistic effects possible through a 
coordinated group effort aimed at a common objective. The work of 
ten volunteers in ten different activities is difficult to measure. 
More important, it is likely to be dissipated by failure to reach 
the critical level required for sustained impact than is a con- 
certed effort by the name number to assist a poverty community in 
establishing an independent self-sustaining consumer cooperative, 
for example. 

. Immediate program activity results are more easily identified 
than the broader consequences of VISTA presence. The program results 
are intermediate steps in a longer-term pattern that merges much of 
theimpact of program and presence. Volunteer teaching and legal pro- 
gram assistance, for example, have distinctive effects that also con- 
tribute to the more general results of VISTA presence. This distinc- 
tion is important in developing prototypes of VISTA impact, our 
method seeks to describe the likely impact of VISTA presence and to 
identify any distinctive additional impacts of program activities. 

When most of the consequences of program activities are indistinguish- 
able from those attributable to presence, total impact can be calcu- 
lated without separate measurement of the program activity results. 
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D. The Impact of Program and Presence 

The impact of VISTA on poverty communities includes effects on 
individuals, groups and agencies. There may also be consequences 
for entire systems, such as those for delivery of particular ser- 
vices and for communication of needs. Most VISTAs, regardless of 
particular project activities or goals, share certain common char- 
acteristics and are part of the same "process." 

Process goals are defined by VISTA only in very general terms. 
VISTA and the volunteers have assumed that good things will happen 
if dedicated volunteers are sent to live with the poor and allowed 
some freedom to act outside the structured bounds of sponsor job 
assignments. VISTA is now concerned to find out what types of good 
things have happened, if any, and to measure them, if possible. 
Successful measurement efforts should make explicit the goals that 
have been implicit in volunteer involvement and may suggest ways of 
improving effectiveness in attaining them. The goal has, in effect, 
been to "be a VISTA," and the question is how this affects the indi- 
viduals, groups, agencies, and systems among which efforts to achieve 
it take place. 



Achievement of program goals is influenced by the VISTA approach 
and the impact of VISTA presence is affected by the program activi- 
ties of the volunteers. The distinction is nevertheless helpful in 
analyzing VISTA impact and determining the utility of attempting 
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various types of measurements or measuring particular projects. 

It is relevant to all types of VISTA activities, though the pre- 
sence effects of Job Corps and mental health work, for example, 
are quite different from those of work with migrant groups. 

VISTA presence and program activities produce results with 
varying degrees of immediacy, visibility, and describability. 

In tutorial programs, for example, the number of students parti- 
cipating for a specific period of time can be counted. Whether 
they learn anything as a result is more difficult to calculate. 
Assuming that they do, it is still harder to recognize and describe 
any effects that may be attributable to their expanded knowledge 
or understanding. The initial outcome, "number of students taught," 
is direct and easily measured, it is unfortunately only an indi- 
cation of input, level of effort, and is little help in appraising 
the value, importance, or effectiveness of VISTA, unless the 
merits of tutoring are assumed without further inquiry. 

The VISTA Activities Surveys record inputs and direct outcomes 
of this type. Although the interviewer’s Manual for those con- 
ducting the Surveys urges that "indirect" results also be noted, 
this is rarely done, possibly because these are more difficult to 
identify and describe. The progress of those tutored, for example, 
is seldom included. More remote results, such as the effects of 
successful tutoring on conduct and attitudes of the students in- 
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volved, are even less likely to be reported currently in the Acti- 
vities Survey or any other documents received by VISTA. The con- 
cern to measure "impact" reflects VISTA's belief that the more 
remote consequences of volunteer efforts may be significant enough 
to justify development of instruments going beyond those presently 
in use. 

Impact has magnitude and duration. The importance of particu- 
lar manifestations varies with these dimensions and the relation- 
ship of the impact to the ultimate goals of anti-poverty efforts. 
Achievement of intermediate goals is valued for itself and because 
it contributes to eliminating poverty. While philosophical dis- 
cussions concerning what is intermediate or final are helpful in 
clarifying objectives, the measurement of impact encompasses both. 

In community organization, for example, the immediate results may 
include the gathering together of a number of people on a regular 
basis and the formalization of their relationship by organization. 
This, in turn, may improve and reflect improvement in, social cohesion 
aspiration levels, participation in decision-making, tolerance, and 
other aspects of group life. To some, these consequences are suf- 
ficiently important to be ends in themselves, changes vital to 
improving the quality of life. For others, they mean little except 
as intermediate steps that may lead to demonstrable improvement 
in satisfaction of wants, living standards, and other more tangible 
evidences of leaving poverty. 




The choice of variables or effects to be measured must be a 
product of preconceptions about relative importance, since measure- 
ment involves abstracting only part of the universe of events. Be- 
cause ttie broad goal of VISTA, helping the poor to move out of 
poverty, is served by so many types of results, and the program 
produces such a variety, early restrictive preconceptions must be 
avoided. Roaming freely in the early conceptualization and observa- 
tion of impact reduces the risk of missing significant findings. 

The impact of VISTA activities and presence can be viewed as 
a spectrum leading from immediate to more remote consequences, 
eliminating some concern for the labelling of "intermediate" 
accomplishments. The quality of remoteness includes both visi- 
bility and time-distance. Tutoring and learning, for example, 
may take place simultaneously, but the learning is less easily 
identified. The learning may eventually help i boy find a job, 
and here the remoteness is temporal as well. 

Program activities are likely to produce some direct, immedi- 
ate effects for which there is no equivalent as a result of pre - 
sence . The absence of readily apparent consequences of the volun- 
teer’s living, and distinctive role, in poverty communities forces 
attention to more remote results in an effort to explain the signi- 
ficance of that presence. 
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The distinction between program and presence impact is partial- 
ly obscured in relation to more remote results. Increased communi- 
cation among neighbors, reduction of tensions, and improvement of 
self-images, effects cited in a pilot measurement study sponsored 
by VISTA*? are attributable to both types of impact. Nevertheless, 
it is clear that program i juivities may vary in their contribution 
to these results and may, at the same time, have other dissimilar 
effects that a*e a function of the activity itself. The major 
VISTA activities can be viewed as having a set of overlapping con- 
sequences that can be illustrated, using health and employment as 
examples, in this wayt 



health 

activities * 



Impact of VISTA 
presence and non- 
program impact of 
program activities 




Program 

Impact 



Program 

Impact 



« employment 

activities 



Evaluation of VISTA Summer Associates Program . Greenleigh 
Associates, New York 1967, p. VII-4. 




These fine distinctions, though difficult to observe in the 
events, are useful in the conceptualization of VISTA impact. It is 
not uncommon, for example, to have VISTA personnel acknowledge 
that a particular job assignment is useful as an "entry into the 
community." This emphasizes that while impressive program re- 
sults are not anticipated, the program activities are expected to 
contribute heavily to the intangible, more general goals that are 
primarily the province of VISTA presence. 

D-l. Program Impact 

The distinction between program and presence impacts 
provides a basis for analyzing the effects of VISTA. The VISTA 
Activities Survey establishes ten categories of activities t 



1. 


Education 


6 . 


Employment 


2. 


Recreation 


7. 


Legal 


3. 


Housing and Neighborhood 
Improvement 


8 . 


Individual Assistance 


4. 


Health 


9. 


Community Organization 


5. 


Income Improvement 


10. 


Supporting Functions 



For each of these categories a cluster of likely results, based on 
observation and analysis, can be identified. The combined impact 
of VISTA presence and the non-program effects of program activities 
can also be described. Following this process, the array can be 
analyzed for similarities, problems of causation, and probable 
magnitude, to restrict the search for indicators to those most 
likely to be useful* 



The Activities Surveys simplify this task because 
direct results of volunteer activities are included in them. Only 
effects less apparent or more remote in time, but often highly 
significant, need be considered in developing other measurements. 

The spectrum of program consequences overlaps with the more general 
presence-type consequences, making it almost impossible to separate 
or measure the latter results for each activity, in education, 
for example, the number of students taught, trained or counseled, 
the number of facilities provided, and the number of parents in- 
duced to participate in education-related organizations, are readily 
derived from Activities Surveys. The effects of the education 
activities on self-images, family functioning, social integration, 
and similar broad variables, are combined in the measure of pre- 
sence impact. There remains only a middle ground of outcomes that 
are directly related to the educational program activities but are 
more remote than those reported in Activities Surveys. These are 
principally effects on learning achievement, school attendance, 
and behavior. 

This conceptual identification is independent of the 
actual occurrence of these results in particular cases and the 
tracing of them to VISTA. It is no more than an hypothesis about 
possible effects, designed to assist in the measurement process. 

The program activities may not yield these types of results, or 
may do so to a degree that makes measurement impractical, but the 
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hypothesis is an indispensable step to discovering this. Because 
the possible intermediate consequences are more tangible and flow 
directly from the immediate outcomes reported in other instruments, 
attribution of them to VISTA is less difficult than for more remote 
intangible impacts involving greater possibility of intervening or 
other contributing causes. 

For recreation, the middle ground of likely impact is 
negligible. After we know tho number of participants, the type 
and extent of their participation, effects become difficult to 
distinguish from those generally attributable to the presence of 
interested VISTA Volunteers. This absence of intermediate conse- 
quences explains the often-expressed skepticism, in both Peace 
Corps and VISTA, about recreation as a program activity. 

Housing and Neighborhood Improvement activities may 
yield results, in addition to the type of immediate outcomes reported 
in Activities Surveys, that are clearly program-related. The per- 
son who improves his home with a volunteer's help may make other 
improvements without the volunteer. The average period of occupancy 
may be increased among tenants organized into an effective council. 
Delinquency and crime may decline because of more street lights or 
improvements in a neighborhood. Selecting a few of the more import- 
ant secondary effects for measurement requires a judgment of both 
their intrinsic importance and the likelihood of their occurrence. 
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This will be attempted later, when alternative measures are con- 
sidered. Our purpose here is to illustrate secondary, middle-level 
effects and to show their variation among VISTA program activities. 

The Output Analysis of VISTA in Columbus, Exhibit I annexed to the 
7 

report of subcommittee hearings on the FY69 OEO appropriation, 
uses a concept of "secondary results" that is similar, but less 
systematic and analytical than the approach suggested here. 

Volunteer health activities result in numbers of people 
being examined or treated, attending health education classes, and 
similar outcomes. As in education, the Activities Surveys rarely 
describe the consequences of these initial, immediately apparent 
occurrences. Reduced disease incidence, adoption of particular 
health practices, and decline in school and job absenteeism, are 
aspects of the impact of successful activities in health. 

For income improvement and employment activities impact 
includes all of the benefits flowing from having more money. Besides 
reductions in the number of people on welfare, it may be possible 
to identify increased consumption of food, growth of retail sales, 
expanded home ownership, and more tax payments, to amplify the 
significance of Activities Surveys reports of jobs found or co- 
operatives organized. Economic betterment is also part of the more 
general category of greater satisfaction of wants, which encompasses 

^ part 6, Hearings before Subcommittee of the Committee on Ap- 
propriations, House of Representatives, on Departments of Labor and 
Health, Education and Welfare, and Related Agencies, 90th Congress, 

O tcond Session, 1968, pp. 496 ff. 

ERIC 
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the entire "improved quality of life" goal to which all VISTA 
efforts are addressed. 

The legal services performed by VISTA volunteers result 
in a number of clients being served. These clients are primarily 
groups and organizations. Services are concentrated on assisting 
with the legal aspects of program development and effective 
negotiation of grievances. The impact of these efforts, beyond 
the fact that groups without previous access to legal services can 
now get help, reflects the tangible benefits of that help. For 
example, housing violations corrected, reductions in the number of 
evictions, and dollar volume of repairs made after complaint, are 
possible measures of the impact of intervention in tenant organi- 
zation disputes with landlords. The number of funding applications 
completed, and grants received, organizations assisted to comply 
with requirements for legal status, and grievances resolved, are 
examples of other intermediate measures. 

Because VISTA lawyers are not generally being used to 
give conventional legal help to individual clients, impact must be 
expressed primarily in terms of the goals of group clients. These 
goals are, in the beginning, indistinguishable from those of com- 
munity organization work. Though substantive changes effected as 
a result of organization will eventually justify tabulation, the 
intermediate measures of community organization are concerned with 
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whether an organization exists and functions effectively. Only 
after the organization has had opportunity to pursue specific pro- 
ject goals should it, or the work of volunteers assisting it, be 
appraised in terms of more tangible accomplishments. 

Measurement of the program impacts described, and 
others like them, can be done on an individual or project basis. 
Where a group of volunteers are doing similar work addressed to 
common program goals, the task is simplified. Review of Activities 
Surveys suggests that many volunteer program accomplishments are 
often distinct from ostensible project assignments. Individuals 
independently pursue various activities that have program-type 
impacts. Before considering limitation of program impact measure- 
ment to projects with well-defined program activities, VISTA might 
experiment with some attempts to measure individual program results 
by screening Activities Surveys and following up program-type out- 
comes identified. More extensive investigations of consequences 
would be based on, and tabulated according to, measures included 
in the education, legal, health, home and Income improvement cate- 
gories suggested here. 

In the absence of a routine management information 
reporting system, the cost of further measurement efforts must be 
weighed against the extent and utility of findings. Perhaps the 
easiest and most economical way to incorporate this type of measure- 
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ment into the VISTA system is to recast the Activities Surveys, 
giving more emphasis to selective intensive measurements of these 
program-type outcomes. The results of individual assistance and 
community organization activities require different treatment. 

D-l-a. Supporting Functions 

VISTA's activity categories of individual assistance, 
community organization, and supporting functions do not involve 
direct provision of program services. The supporting function 
role involves "slot filling" and often reflects sponsor misunder- 
standing of VISTA intent. Volunteers occasionally serve as part of 
the sponsor's administrative or clerical staff, frequently perform- 
ing structured assignments for which little impact beyond the actual 
task performed can be identified. Common Activity Survey entries 
like "cooked for 35 children at center" or "assisted staff with 
administrative work" describe important work, but any VISTA con- 
tribution to broader goals is primarily a matter of presence and 
is measurable as part of the more general VISTA impact. 

The inpact of volunteers performing supporting functions 
is reflected in the reports of their sponsors. This is also true 
of many program activities. Volunteers making a survey for a health 
agency, for example, are part of the broad effort and impact of that 
agency. VISTA could let the reports of sponsors be the measure of 
volunteer impact, viewing itself as a provider of manpower to use- 
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ful institutions. Impact would be reflected in the number and 
type of satisfied sponsors and VISTAs. Justification for treating 
VISTA as something beyond a placement agency comes from the often 
stated and less frequently documented assertion that the VISTA 
is more than an employee of the sponsor and brings to the poverty 
community a presence and approach that yields consequences beyond 
those resulting from conventional performance of a job assignment. 

D-l-b. Individual Assistance 

individual assistance is the essence of that presence. 
Some volunteers are assigned full-time casework roles and practi- 
cally all are involved for part of their time in various forms of 
individual assistance. The establishment of personal relation- 
ships with poor people through outreach and continued contact, 
and the development of mutual trust and confidence, often produce 
reliance on the volunteer for moral support and help with day-to- 
day problems and, through this, may stimulate greater efforts 
by the poor to help themselves. Activities Surveys are little 
help beyond identifying the number of people served or referred 
and the diversity of assistance given by volunteers challenges 
easy tabulation. Measuring what happens to people who are "served" 
by VISTA calls for identification of results at a level of generali- 
sation broad enough to encompass the variety of outcomes. 

The paradox that "helping people to help ’.nemselves" 

O :en involves referring them to available services makes their 
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increased use of services an ambiguous measure of that intangible, 
since more dependency may also be involved. Nevertheless, changes 
in the use of health, welfare, employment, and other services are 
an important aspect of VISTA impact. 

Although the indirect results of individual referrals 
may be similar to those for other volunteer program activities, 
the VISTA contribution is primarily in the linking and motivation 
that produce referral and participation. The change in attitude 
and conduct may be more important than the delivery of services. 

For example, if 20 people are motivated by volunteers to seek health 
services and their physical well-being later improves, the impact 
of VISTA is greater than what occurs if the 20 arrive at the health 
agency independently and there receive program services from volun- 
teers, This distinction reflects the intangible quality of much 
presence impact in comparison to the more concrete results usually 
associated with program activities, 

D-l-c. Community organization 

Community organization, like individual assistance, cuts 
across program lines. Both categories are intermediate to many dif- 
ferent program or service goals, though also process goals in them- 
selves. Activities Surveys that include community organization 
efforts report number of participants, number of meetings, and 
number of organizations formed, but VISTA Volunteers and others 
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concerned with community organization are quick to assert that these 
figures do not give useful or complete pictures of effectiveness or 
impact* Among the process goals cited are "changing attitudes," 
"increasing participation in decision-making," "helping people to 
work together and help themselves," "giving the poor political 
power," "developing leaders," and "improving problem-solving 
ability," The intermediate results of some community organization 
activity are similar to the outcomes of the common program activities. 
For example, organization is often a vital aspect of efforts to 
improve housing conditions. VISTA acknowledges this by excluding 
from the community organization category in Activities Survey 
instructions! 

"Community organization activities which are 
directed exclusively toward the areas of edu- . 
cation, health, income improvement, employment, 
or housing and neighborhood improvement." 

The remaining activities are a kind of pure, undifferentiated com- 
munity organization, for which intermediate results, what the organi- 
zations "accomplished," are initially less important to the organi- 
zers than the process itself. The Activities Surveys already 
capture many of these intermediate results (e.g., "organized pro- 
test to mayor's office" or "group petitioned and street light was 
installed") and there is little current need for other measures at 
this level. The measurement of impact at the broader level of 
generalization implied by the various statements of objectives goes 
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to the roots of the VISTA problem. The program activities of 
volunteers (health, recreation and the other functional categories) 
and the activities that include individual assistance, community 
organization, and extra-program presence, are suspected to have 
a generalized positive impact that is more difficult to con- 
ceptualize than program results and far harder to identify and 
measure. While secondary program results are tangible and measur- 
able directly, the impact of process or presence, together with 
other consequences of program activity, is primarily intangible 
and therefore measurable only indirectly by reference to answers 
or other indicators assumed to reflect it. Recognition that an 
intangible such as "changing attitudes" occurs between activity 
and indicator is useful in defining goals and directing emphasis, 
but need not impede the appraisal of performance and the expression 
of impact by reference to less abs tract, related variables. 

D-2. Presence Impact 

To the extent that the activities and presence of VISTA 
Volunteers are successful, the attitudes and conduct of the poor are 
influenced. The program activities, too, contribute to the total 
effect on attitudes. Although VISTA has not been specific about 
the attitudinal or behavioral changes desired, some common state- 
ments can be identified. In individual terms, these might includet 
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1. higher achievement motivation 

2. more tolerance of strangers and new ideas 

3. more perception of needs and satisfaction of wants 

4. improved self-images 

5. greater problem-solving and coping ability 

6. broader experience and confidence in ability to affect 

personal situation 

7. improved family functioning 



In group terms, the effects include? 

1. increased participation in decisions affecting group welfare 

2. increased communication, reduction of social distance 

3. greater sense of community identity 

4. greater confidence and capacity for social action 

5. more social power 

6. reduced tension 

7. linkages with other groups 



These goal statements, assembled from both academic 
literature and reference to VISTA Activities Surveys and Evaluation 
Reports, are used to describe changes desired or anticipated by 
VISTA and others as results of volunteer efforts. 



An assumption that the "intangible results" contribute 
to the elimination of poverty underlies VISTA efforts. The measure- 
ment of these results does not require commitment to this view or 
to the reverse, that the elimination of economic poverty will itself 
bring about these desired attitude changes. After impact has been 
identified and measured, the comparative effectiveness of approaches 
to influencing it can be examined. 

Although all results are manifested through individual 

attitudes and behavior, the dichotomy of individual and social 
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effects is useful for conceptualizing what is to be measured. 

Despite t, me overlapping (e.g., when individual self-images improve, 
social participation is likely to increase) , the nature of VISTA 
efforts militates in favor of the dual description. Individual 
assistance and community organization produce individual growth 
and group change. The impact of VISTA on poverty communities 
includes both and individual volunteers vary in emphasizing each 
of them. 

The VISTA program is transitional assistance designed 
to bring individuals and their communities to a non-poverty condi- 
tion by improving individual and social competence, morale, and 
power. The intangible change goals listed previously are encompassed 
by these categories. Improved individual and social knowledge, 
morale, and power result in more effective adaptive behavior by 
the poor. Provision of services, by VISTA and other agencies, is 
intermediate to these ends, and VISTA impact includes both the 
tangible results of services and any intangible consequences. These 
simple distinctions are enough to suggest a framework for measure- 
ment. However, before outlining the details of specific measure- 
ment techniques, some consideration of previous attempts to measure 
attitudes will illustrate the difficulties involved in moving from 
the analytical framework to its operational specification. 




